Skip to content

CI: benchmark pip cache reuse - #24064

Closed
vyasr wants to merge 2 commits into
NVIDIA:mainfrom
vyasr:codex/pip-cache-benchmark-control
Closed

CI: benchmark pip cache reuse#24064
vyasr wants to merge 2 commits into
NVIDIA:mainfrom
vyasr:codex/pip-cache-benchmark-control

Conversation

@vyasr

@vyasr vyasr commented Sep 9, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Description

Temporary control for measuring pip-cache impact.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes (temporary CI benchmark).

@copy-pr-bot

copy-pr-bot Bot commented Sep 9, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@vyasr vyasr added ci cudf.pandas Issues specific to cudf.pandas labels Sep 9, 2026
@vyasr

vyasr commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

@vyasr

vyasr commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

1 similar comment
@vyasr

vyasr commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

@vyasr
vyasr force-pushed the codex/pip-cache-benchmark-control branch from 6230dc8 to 3884a71 Compare September 9, 2026 18:16
@vyasr

vyasr commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

@vyasr

vyasr commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test

@vyasr

vyasr commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

Intra-job pip-cache results

I compared the clean full-CI baseline (run 34388028288) with the cache-enabled run (run 34396369088). The latter uses the SHA-pinned rapids-init-pip prototype for every direct caller, without any actions/cache pip configuration.

The cache is working: a completed pandas job reports PIP_CACHE_DIR=/__w/cudf/cudf/.cache/pip and later pip invocations report Using cached for dependency metadata and wheels.

Job family Baseline avg. Intra-job cache avg. Delta
wheel C++ builds 435.8 s 419.3 s -16.5 s
wheel Python builds 343.3 s 340.8 s -2.5 s
wheel noarch builds 247.0 s 243.0 s -4.0 s
wheel-cuDF tests 751.8 s 770.6 s +18.9 s
wheel-cuDF-Polars tests 736.5 s 768.5 s +32.0 s
pandas shards 1528.5 s 1556.5 s +28.0 s
Narwhals 217.0 s 210.0 s -7.0 s

The full runs have the same substantive failures: the two unavailable devcontainer pip images and the optional third-party pandas-integration job. The cache is functioning, but this broad comparison does not show a measurable end-to-end benefit beyond normal runner/test variance. The next useful question is which jobs actually make multiple pip invocations within one container.

@vyasr

vyasr commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

The primary purpose of this PR was to test rapidsai/gha-tools#277. That PR is now merged, so we no longer need this one.

@vyasr vyasr closed this Sep 9, 2026
@github-project-automation github-project-automation Bot moved this from Todo to Done in cuDF Python Sep 9, 2026
@vyasr
vyasr deleted the codex/pip-cache-benchmark-control branch September 9, 2026 22:03
@vyasr vyasr mentioned this pull request Oct 14, 2026
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@vyasr vyasr

Labels

ci cudf.pandas Issues specific to cudf.pandas

Projects

cuDF Python
Archived in project

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vyasr